(19) 



(12) 



EuropSisches Patentamt 
European Patent Office 
Off ice europeen des brevets (11) EP 0 831 654 A1 

EUROPEAN PATENT APPLICATION 



<3- 
ID 



(43) Date of publication: 

25.03.1998 Bulletin 1998/13 

(21) Application number: 961 1 5250.1 

(22) Date of filing: 23.09.1 996 



(51) int. Cl. 6 : H04N 7/26, G06T 9/20, 
H04N 7/30 



(84) Designated Contracting States: 


(74) Representative: 


DE FR GB IT 


von Samson-Himmelstjerna, Friedrich R., Dipl.- 




Phys. et al 


(71) Applicant: 


SAMSON & PARTNER 


DAEWOO ELECTRONICS CO., LTD 


Widenmayerstrasse 5 


Seoul (KR) 


80538 Munchen (DE) 


(72) Inventor: Kim, Jin-Hun 




Namdaemoon-Ro, Jung-Gu, Seoul (KR) 





(54) Method and apparatus for encoding a contour image of an object in a video signal 



(57) An apparatus for encoding a contour of an 
object determines a number of vertex points based on a 
polygonal approximation to the contour. A set of approx- 
imation errors calculated at a predetermined number of 
sample points on each line segment between two adja- 
cent vertex points is transformed to obtain a corre- 
sponding set of transform coefficients. The apparatus 



converts, in response to a masking range designation 
signal corresponding to each line segment a part of the 
set of transform coefficients to zeros and produces a set 
of masked transform coefficients corresponding thereto. 
The set of masked transform coefficients is quantized 
and encoded to be transmitted through a transmitter. 
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1 EPO 

Description 

The present invention relates to a method and 
apparatus for encoding a video signal; and, more partic- 
ularly, to a method and apparatus capable of effectively 
encoding a contour of an object contained in a video 
signal, thereby reducing the amount of data to be trans- 
mitted. 

In digital television systems such as video-tele- 
phone, teleconference and high definition television 
systems, a large amount of digital data is needed to 
define each video frame signal since a video line signal 
in the video frame signal comprises a sequence of dig- 
ital data referred to as pixel values. Since, however, the 
available frequency bandwidth of a conventional trans- 
mission channel is limited, in order to transmit the large 
amount of digital data therethrough, it is inevitable to 
compress or reduce the volume of data through the use 
of various data compression techniques, especially, in 
the case of such low bit-rate video signal encoders as 
video-telephone and teleconference system. 

One of such techniques for encoding video signals 
for a low bit-rate encoding system is an object-oriented 
analysis-synthesis coding technique, wherein an input 
video image is divided into objects and three sets of 
parameters for defining the motion, the contour and the 
pixel data of each object are processed through differ- 
ent encoding channels. 

In processing a contour of an object, contour infor- 
mation is important for the analysis and synthesis of the 
object shape. A classical coding method for represent- 
ing the contour information is a chain coding method. 
The chain coding method, however, requires a substan- 
tial amount of bits for the representation thereof, 
although the method does not incur any loss in the con- 
tour information. 

To overcome the drawback, there have been pro- 
posed several methods to encode the contour informa- 
tion such as a polygonal approximation and a B-spiine 
approximation. One of the disadvantages in the polygo- 
nal approximation is the roughness of the representa- 
tion of the contour. The B-spline approximation is, on 
the other hand, capable of representing the contour 
more precisely; however, it requires a high-order poly- 
nomial to reduce the approximation error and results in 
an increased overall computational complexity of the 
video encoder. 

One of the techniques introduced to ameliorate 
such problems associated with the rough representa- 
tion of the contour and the increased computational 
complexity in the above approximation approaches is a 
contour approximation technique employing a discrete 
sine transform(DST). 

In an apparatus which adopts the contour approxi- 
mation technique based on the polygonal approxima- 
tion and the DST, as disclosed in a commonly owned 
copending application, European Patent Application No. 
95105653.0-1241, entitled "A CONTOUR APPROXI- 



531 654 A1 2 

MAT ION APPARATUS FOR REPRESENTING A CON- 
TOUR OF AN OBJECT", a number of vertex points are 
determined and the contour of an object is approxi- 
mated through the use of polygonal approximation for 

5 fitting the contour by line segments. And, N sample 
points on each line segment are selected and an 
approximation error at each of the N sample points 
located on each line segment is sequentially calculated 
in order to obtain a set of approximation errors for each 

10 line segment. The N sample points are equi-distanced 
on each line segment and each of the approximation 
errors represents the distance between the contour and 
the line segment at each of the N sample points. There- 
after, sets of DST coefficients are generated by per- 

75 forming a one-dimensional DST operation on each set 
of approximation errors. 

Even though it is possible to remedy the rough rep- 
resentation and computational complexity and reduce 
the volume of transmission data through the use of the 

20 DST-based contour approximation, it still remains desir- 
able to further reduce the volume of transmission data 
in order to efficiently implement a low-bit rate codec sys- 
tem having, e.g., a 64 kb/s transmission channel band- 
width. 

25 It is, therefore, a primary object of the invention to 
provide an improved method and apparatus for encod- 
ing a contour of an object in a video signal, which is 
capable of further reducing the amount of transmission 
data through properly masking DST coefficients accord- 
so ing to outputs of the polygonal approximation process. 

Another object of the present invention is to provide 
an improved method and apparatus capable of enhanc- 
ing the quantization effectiveness by using an adaptive 
quantizer having various quantization step sizes. 

35 In accordance with the invention, there is provided 
a method for encoding a contour of an object expressed 
in a video signal, wherein the method comprises the 
steps of: (a) determining a number of vertex points on 
the contour; (b) providing a polygonal approximation to 

40 the contour by fitting the contour with a multiplicity of 
line segments, to thereby generate vertex information 
representing the positions of the vertex points of the 
contour, each of the line segments joining two adjacent 
vertex points; (c) taking N sample points on each of the 

45 line segments and calculating an error at each of the N 
sample points on each of the line segments to produce 
a set of errors for each of the line segments, wherein the 
N sample points are equi-distanced on each of the line 
segments and an error at a sample point on a line seg- 

so ment represents a distance from the line segment to a 
corresponding contour at the sample point, N being a 
positive integer; (d) transforming each set of errors for 
each of the line segments into each set of transform 
coefficients corresponding thereto; (e) calculating a 

55 length L of each of the line segments between two adja- 
cent vertex points; (f) masking, according to the length 
L and the number N, none or some parts of each set of 
transform coefficients in order to produce each set of 
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masked transform coefficients corresponding thereto; 
(g) quantizing, based on a first quantization step size, 
low frequency coefficients among each set of masked 
transform coefficients into a first set of quantized trans- 
form coefficients; (h) quantizing, based on a second s 
quantization step size, high frequency coefficients 
among each set of masked transform coefficients into a 
second set of quantized transform coefficients; and (i) 
encoding the quantized transform coefficients for each 
corresponding line segment. w 

The above and other objects and features of the 
present invention will become apparent from the follow- 
ing description of preferred embodiments given in con- 
junction with the accompanying drawings, in which: 

15 

Fig. 1 depicts a schematic block diagram of the 
inventive apparatus for encoding a contour of an 
object; 

Fig. 2 presents a detailed block diagram of a mask- 
ing control block shown in Fig. 1 ; 20 
Figs. 3A to 3D illustrate an exemplary polygonal 
approximation process of the contour of an object; 
Figs. 4A and 4B show exemplary diagrams, each 
representing errors between a line segment joining 
two vertex points and its corresponding contour 25 
segment; 

Fig. 5 offers a process for calculating a length of a 
line segment; and 

Fig. 6 represents exemplary results of a masking 
process. 30 

Referring to Fig. 1, there is shown a schematic 
block diagram of the inventive apparatus for encoding a 
contour of an object expressed in a video signal in 
accordance with the present invention. 35 

Contour image data of the object in the video signal 
is inputted to a polygonal approximation block 1 00 and 
a sampling & error detection block 200. 

At the polygonal approximation block 100, a polyg- 
onal approximation to the contour of the object shape 40 
inputted thereto is achieved through the use of a con- 
ventional approximation algorithm for fitting the contour 
with line segments. 

Referring to Figs. 3A to 3D, there is illustrated a 
process of a polygonal approximation to an exemplary as 
contour 10, wherein two starting vertex points are first 
selected. If the contour is of an open loop, two end 
points, e.g., A and B as shown in Fig. 3A, are selected 
as the starting vertex points. On the other hand, if the 
contour is in the form of a closed loop, two farthest so 
points on the contour are selected as the starting vertex 
points. And then, a farthest point, e.^., C, on the contour 
1 0 from a line segment AB is determined. If the distance 
D max from the point C on the contour to the line seg- 
ment AB is greater than a predetermined threshold ss 
value TH1, the point C is selected as another vertex 
point. This procedure is repeated until the D max for each 
line segment connecting two adjacent vertex points 
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becomes equal to or smaller than the predetermined 
threshold value TH1. 

The number of vertex points varies depending on 
the predetermined threshold value TH1 . As can be seen 
from Figs. 3 A to 3D, the approximation to the contour 10 
by line segments becomes more accurate as the prede- 
termined threshold value TH1 becomes smaller, at the 
expense of coding efficiency. 

Referring back to Fig. 1, vertex information repre- 
senting the positions of all the determined vertex points, 
e.g., A to G on the contour 10 is provided via a line L10 
from the polygonal approximation block 100 to the sam- 
pling & error detection block 200, a masking control 
block 600 and a vertex coder 900. 

The sampling & error detection block 200 selects N 
sample points on each line segment and calculates an 
approximation error at each of the N sample points on 
each line segment based on the vertex information and 
the contour image data, wherein the N sample points 
are equi-distanced on each line segment between two 
vertex points with N being a positive integer. The 
approximation error at a sample point represents a dis- 
tance between a line segment joining two vertex points 
and its corresponding contour segment at the sample 
point. 

Figs. 4A and 4B illustrate exemplary diagrams rep- 
resenting approximation errors between line segments 
and corresponding contour segments, wherein Fig. 4A 
depicts approximation errors between the line segment 
AD and its corresponding contour segment at sample 
points on the line segment AD and Fig. 4B shows 
approximation errors between the line segment CF and 
its corresponding contour segment at sample points on 
the line segment CF. Each of the errors d1 to d8 or dV 
to d8' represents the distance from each sample point 
S1 to S8 on the line segment AD or Si ' to S8' on the line 
segment CF to the corresponding contour segment. As 
can be seen in Figs. 4A and 4B, the approximation 
errors at the vertex points are all "zeros", since all the 
vertex points are on the contour. 

The approximation errors calculated at the sam- 
pling & error detection block 200 are supplied to a DST 
block 400. The DST block 400 performs, in accordance 
with one preferred embodiment of the present invention, 
one-dimensional DST operation on each set of approxi- 
mation errors for each of the line segments to produce 
each set of DST coefficients corresponding thereto, 
wherein a set of approximation errors for a line segment 
includes approximation errors at N sample points on the 
line segment. The set of DST coefficients generated at 
the DST block 400 is provided to a masking block 500. 

In the meantime, the masking control block 600 cal- 
culates a length of each of the line segments based on 
the vertex information on the line L10 and produces a 
masking range designation signal S MC by using the 
length of each of the line segments and the number N to 
control the masking block 500. 

Referring to Fig. 2, there is presented a detailed 
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block diagram of the masking control block 600 employ- 
ing a length calculation sector 610 and a masking range 
determination sector 620. The length calculation sector 
610 determinates the length of each of the line seg- 
ments sequentially based on the vertex information as 5 
shown in Fig. 5. That is, the sector 610 calculates a dif- 
ference between two vertex points V1 and V2 on the line 
segment and rounds off the difference to a nearest inte- 
ger and then provides the integer as a length L of the 
line segment to the masking range determination sector 10 
620. The masking range determination sector 620 cal- 
culates the masking range designation signal S MC 
according to the following equation and then outputs it 
via a line L20 to the masking block 500. 

is 

S M c 1) EQ.1 

wherein S MC represents a masking range designation 
signal corresponding to a line segment; N is the number 
of sample points; and L denotes a length of the line seg- 20 
ment between two vertex points. 

However, if the masking range designation signal 
Smc is calculated to be less than 0, then it is reset to be 
0. 

The masking block 500 masks, in response to the 25 
masking range designation signal S MC corresponding 
to each of the line segments supplied via the line L20, 
high frequency coefficients among the DST coefficients 
for each of line segments in order to reduce the amount 
of transmission data. As a result of the masking proc- 30 
ess, S MC number of high frequency coefficients are con- 
verted to 0's. That is, as shown in Fig. 6, if the number 
N is 8 and a length L is 2, then S MC is 7 and 7 shaded 
high frequency coefficients are masked, and when L is 
5, then S MC is 4 and 4 shaded high frequency coeffi- 35 
cients are masked. 

On the other hand, according to another preferred 
embodiment of the present invention, the DST block 
400 carries out one-dimensional DST operation on each 
set of approximation errors for each of the line seg- 40 
ments to produce each set of DST coefficients corre- 
sponding thereto, wherein a set of approximation errors 
for a line segment includes errors at N sample points 
and two vertex points on the line segment. The set of 
DST coefficients generated at the DST block 400 trans- 45 
fers to the masking block 500 same as to the former 
embodiment of the present invention. 

In this case, the masking range determination sec- 
tor 620 in the masking control block 600 produces the 
masking range designation signal S MC by using the so 
equation EQ. 1 , wherein N is replaced by N + 2 because 
the number of the approximation errors is increased by 
2. And, in case that the masking range designation sig- 
nal $mc ' s less than 0, it is reset to be 0. 

The masking block 500 also masks each set of DST ss 
coefficients in response to the above masking range 
designation signal S MC in the same manner as used in 
the former embodiment of the present invention and 



provides first and second quantization blocks 710 and 
720 with each set of masked DST coefficients. 

The set of DST coefficients have a statistical distri- 
bution in a frequency region between a d.c. component 
zone and a high frequency zone with non-zero or signif- 
icant transform coefficients appearing mainly in the low 
frequency zone and zero or insignificant transform coef- 
ficients appearing mainly in the high frequency zone. 
Therefore, it is more advantageous that the low fre- 
quency coefficients is quantized by using smaller quan- 
tization step size than that used for the high frequency 
coefficients. 

Consequently, the first and the second quantization 
blocks 710 and 720 quantize, by using different quanti- 
zation step sizes ST1 and ST2, low frequency and high 
frequency components of each set of masked DST 
coefficients, respectively, to produce a set of quantized 
DST coefficients corresponding thereto to a coefficient 
coder 800. The quantization step sizes ST1 and ST2 
used at the first and second quantization blocks 710 
and 720, separately, are determined as follows: 

ST1 = 4 • TH1/2 • (M+1) EQ.2 

ST2 = 4 • TH1/{M+-\) EQ.3 

wherein TH1 represents a predetermined threshold 
value; and M is the number of the quantization step. 

That is, by means of the above equations EQ. 2 and 
EQ. 3, the quantization step size ST2 becomes twice 
the quantization step size ST1. The coefficients quan- 
tized by the quantization step size ST1 are more accu- 
rate, because the smaller the step size becomes, the 
smaller the errors of quantized data become. 

At the coefficient coder 800, the quantized DST 
coefficients are encoded, e.g., through a binary arith- 
metic code of JPEG(Joint Picture Experts Group), and 
the encoded quantized DST coefficients are then trans- 
mitted to a channel coder 950. 

The vertex coder 900 encodes the vertex informa- 
tion from the polygonal approximation block 100 by 
using, e.g., a conventional syntax arithmetic code or the 
binary arithmetic code, and provides the coded vertex 
information to the channel coder 950. 

The channel coder 950 encodes the coded vertex 
information together with the encoded quantized DST 
coefficients and provides an encoded contour signal 
comprising the coded vertex information and the 
encoded quantized DST coefficients to a transmitter(not 
shown) for transmission thereof. 

While the present invention has been described 
with respect to the particular embodiments, it will be 
apparent to those skilled in the art that various changes 
and modifications may be made without departing from 
the scope of the invention as defined in the following 
claims. 
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Claims 

1. A method for encoding a contour of an object 
expressed in a digital video signal, comprising the 
steps of: 5 



- 2. The method according to claim 1 , wherein the step 
(f) includes the steps of: 

(f11) generating a masking range designation 45 
signal corresponding to each of the line seg- 
ments based on the length L and the number 
N; and 

(f 12) masking, in response to the masking 
range designation signal, said each set of so 
transform coefficients in order to produce said 
each set of masked transform coefficients cor- 
responding thereto. 

3. The method according to claim 2, wherein the ss 
length L is determined by calculating a difference 
between two adjacent vertex points on a line seg- 
ment and rounding it off to a nearest integer. 



4. The method according to claim 3, wherein the step 
(f12) converts M high frequency coefficients, start- 
ing from a highest frequency coefficient, of each set 
of transform coefficients to zeros, M being equal to 
the value of the masking range designation signal. 

5. The method according to claim 4, wherein the 
masking range designation signal S MC for each of 
the line segments is generated as follows: 

wherein N is the number of sample points; and L 
denotes a length of the line segment between two 
adjacent vertex points, and wherein the number of 
the masking range designation signal is reset to be 
0 when it is less than 0. 

6. The method according to claim 4, wherein, if the set 
of errors for each of the line segments in the step 
(d) further includes errors at two vertex points on 
each of the line segments, the masking range des- 
ignation signal S MC for each of the line segments is 
generated as follows: 

S MC -(A/ + 2)-(Z.-1) 

7. The method according to claim 1 , wherein the step 
(g) includes: 

(g1 1) quantizing, based on a first quantization 
step size, low frequency coefficients among 
each set of masked transform coefficients into 
a first set of quantized transform coefficients; 
and 

(g12) quantizing, based on a second quantiza- 
tion step size, high frequency coefficients 
among each set of masked transform coeffi- 
cients into a second set of quantized transform 
coefficients. 

8. The method according to claim 7, wherein the step 
(g11) quantizes a first and a second coefficients in 
said each set of masked transform coefficients. 

9. The method according to claim 8, wherein the sec- 
ond quantization step size is twice the first quanti- 
zation step size. 

10. An apparatus for encoding a contour of an object 
expressed in a digital video signal, comprising: 

- means for determining a number of vertex 
points on the contour; 

means for providing a polygonal approximation 
to the contour by fitting the contour with a mul- 
tiplicity of line segments, to thereby generate 
vertex information representing the positions of 



(a) determining a number of vertex points on 
the contour; 

(b) providing a polygonal approximation to the 
contour by fitting the contour with a multiplicity io 
of line segments, to thereby generate vertex 
information representing the positions of the 
vertex points of the contour, each of the line 
segments joining two adjacent vertex points; 

(c) taking N sample points on each of the line is 
segments and calculating an error at each of 
the N sample points on each of the line seg- 
ments to produce a set of errors for each of the 
line segments, wherein said N sample points 
are equi -distanced on each of the line seg- 20 
ments and an error at a sample point on a line 
segment represents a distance from the line 
segment to a corresponding contour at the 
sample point, N being a positive integer; 

(d) transforming each set of errors for each of 25 
the line segments into each set of transform 
coefficients corresponding thereto; 

(e) calculating a length L of each of the line 
segments between two adjacent vertex points; 

(f) masking, according to the length L and the 30 
number N, none or some parts of each set of 
transform coefficients in order to produce each 

set of masked transform coefficients corre- 
sponding thereto; 

(g) converting each set of masked transform 35 
coefficients into each set of quantized trans- 
form coefficients corresponding thereto; and 

(h) encoding each set of quantized transform 
coefficients for each corresponding line seg- 
ment. 40 



45 
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the vertex points of the contour, each of the line 
segments joining two adjacent vertex points; 
means for taking N sample points on each of 
the line segments and calculating an error at 
each of the N sample points on each of the line s 
segments to produce a set of errors for each of 
the line segments, wherein said N sample 
points are equi-distanced on each of the line 
segments and an error at a sample point on a 
line segment represents a distance from the io 
line segment to a corresponding contour at the 
sample point, N being a positive integer; 
means for transforming each set of errors for 
each of the line segments into each set of 
transform coefficients corresponding thereto; 15 
means for calculating a length L of each of the 
line segments between two adjacent vertex 
points; 

means for masking, according to the length L 
and the number N, none or some parts of each 20 
set of transform coefficients in order to produce 
each set of masked transform coefficients cor- 
responding thereto; 

means for converting each set of masked 
transform coefficients into each set of quan- 25 
tized transform coefficients corresponding 
thereto; and 

means for encoding each set of quantized 
transform coefficients for each corresponding 
line segment. 30 

11. The apparatus according to claim 10, wherein the 
masking means includes: 

means for generating a masking range desig- 35 
nation signal corresponding to each of the line 
segments based on the length L and the 
number N; and 

means for masking, in response to the masking 
range designation signal, said each set of 40 
transform coefficients in order to produce said 
each set of masked transform coefficients cor- 
responding thereto. 

12. The apparatus according to claim 11, wherein the 45 
length L is determined by calculating a difference 
between two adjacent vertex points on a line seg- 
ment and rounding it off to a nearest integer. 

13. The apparatus according to claim 12, wherein the so 
masking means converts M high frequency coeffi- 
cients, starting from a highest frequency coefficient, 

of each set of transform coefficients to zeros, M 
being equal to the value of the masking range des- 
ignation signal. 55 

14. The apparatus according to claim 13, wherein the 
masking range designation signal S M c for ea ch of 



the line segments is generated as follows: 

S«c-A/-<L-1) 

wherein N is the number of sample points; and L 
denotes a length of the line segment between two 
adjacent vertex points, and wherein the number of 
the masking range designation signal is reset to be 
0 when it is less than 0. 

15. The apparatus according to claim 13, wherein, if the 
set of errors for each of the line segments further 
includes errors at two vertex points on each of the 
line segments, the masking range designation sig- 
nal S MC for each of the line segments is generated 
as follows: 

S MC =(/V + 2)-(L-1) 

16. The apparatus according to claim 10, wherein the 
quantization means includes: 

first means for quantizing, based on a first 
quantization step size, low frequency coeffi- 
cients among each set of masked transform 
coefficients into a first set of quantized trans- 
form coefficients; and 

second means for quantizing, based on a sec- 
ond quantization step size, high frequency 
coefficients among each set of masked trans- 
form coefficients into a second set of quantized 
transform coefficients. 

17. The apparatus according to claim 16, wherein the 
first quantizing means quantizes a first and a sec- 
ond coefficients iivsaid each set of masked trans- 
form coefficients. 

18. The apparatus according to claim 17, wherein the 
second quantization step size is twice the first 
quantization step size. 

19. A video coder having an apparatus for encoding a 
contour of an object in a video signal, wherein said 
apparatus comprises: 

approximation means for determining a 
number of vertex points on the contour, to 
thereby generate vertex information, represent- 
ing the positions of the vertex points of the con- 
tour, by using polygonal approximation fitting 
the contour with a multiplicity of line segments, 
each of the line segments joining two adjacent 
vertex points; 

error detection means for taking N sample 
points on each of the line segments and calcu- 
lating an error at each of the N sample points 
on each of the line segments to produce a set 
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of errors for each of the line segments, wherein 
said N sample points are equi-distanced on 
each of the line segments and an error at a 
sample point on a line segment represents a 
distance from the line segment to a corre- 5 
sponding contour at the sample point, N being 
a positive integer; 

transformation means for transforming each 
set of errors for each of the line segments into 
each set of transform coefficients correspond- 10 
ing thereto; 

length determination means for calculating a 
length L of each of the line segments between 
the two adjacent vertex points by rounding off a 
difference between the two adjacent vertex 75 
points to a nearest integer; 
selection means for selecting, according to the 
length L, some or all parts of each set of trans- 
form coefficients in order to produce each set 
of masked transform coefficients correspond- 20 
ing thereto; 

quantization means for quantizing each set of 
masked transform coefficients in order to pro- 
duce each corresponding set of quantized 
transform coefficients; and 25 
encoding means for encoding each set of 
quantized transform coefficients for each of the 
line segments. 

20. The video coder according to claim 1 9, wherein the 30 
selection means selects P low frequency coeffi- 
cients, starting from a lowest frequency coefficient, 
of each set of transform coefficients as available 
coefficients in order to produce each set of masked 
transform coefficients corresponding thereto, P 35 
being proportional to the length L. 
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